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METHOD AND DEVICE FOR DETECTING THE ORIENTATION 

OF AN IMAGE 

The invention relates to a device and a method for detecting the 
orientation of an image. 

The invention relates more generally to the automatic detection of the 
orientation of an image, that may possibly also contain text. 

Like scanners, digital cameras generate photos which are often viewed 
on a screen, such as a computer screen. These images may be viewed 
correctly, that is to say in the right orientation or in a sense that does not allow 
the user to view them without having to turn his head to the left or to the right, 
or even to lower his head. 

Specifically, sensing apparatus, such as digital cameras, can capture 
images in several senses, and in particular it is not uncommon for a user to 
take some of his photos in portrait mode and others in landscape mode. The 
photos thus taken are then transferred to a computer and all viewed in the 
same sense. Some will therefore be correctly viewed while others will require 
a 90, 180 or 270 degree rotation to be viewed correctly. 

Certain sensing devices and in particular certain digital cameras 
possess orientation sensors that detect a rotation of the objective and transmit 
a rotation cue obtained from the sensor with the image. This allows the 
viewing device, by virtue of the rotation cue, to automatically perform a 
rotation of the image so that the latter appears in the correct sense. 

Other devices use methods for extracting the low-level or high-level 
characteristics of the image. This makes it possible to analyse the content of 
the image in terms of colour, texture and also in terms of semantic content. 

However, such devices are not robust for all types of images. 

The invention relates more particularly to the automatic rotation of 
images in viewing devices not receiving any orientation cue from the sensing 
device and exhibiting particular geometries. 
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The invention relates to a method for detecting the orientation of an 

image. 

According to the invention, the method comprises the steps of: 

- detecting the lines in the image, 

- calculating, for each line detected, attributes characterizing each line, 

- detecting the orientation of the image as a function of the attributes of the 
set of lines detected. 

When a landscape containing horizontal lines and vertical lines is 
looked at, in profile, the vertical lines remain vertical, whereas the horizontal 
lines are oblique. 

Thus, those photos containing a large percentage of vertical lines may 
be considered to be photos whose orientation is correct. On the other hand, 
those photos that contain a large percentage of horizontal lines may be 
considered to be photos that have to undergo a rotation in order to be viewed 
correctly. This is illustrated by Figure 1 . 

The method is particularly suitable for images containing several 
horizontal and vertical lines. It may, advantageously, be used as a supplement 
to known procedures of automatic detection of orientation. 

According to a preferred embodiment, the step of detecting the lines in 
the image comprises the substeps of 

- detecting contours, 

- thresholding the gradient of luminance of the points belonging to each 
contour detected. 

According to a preferred embodiment, the step of detecting the 
orientation consists of detecting by learning the orientation of the image. 

The invention also relates to a device for detecting the orientation 
of an image, characterized in that it comprises means for: 

- detecting the lines in the image, 

- calculating, for each line detected, attributes (F) characterizing this line, 

- detecting the orientation of the image as a function of the attributes of the 
set of lines detected. 
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The invention also pertains to a computer programme product, 
characterized in that it comprises programme code instructions able to 
implement the method according to one of Claims 1 to 5 when the programme 
is executed on a computer. 

The invention will better understood and illustrated by means of 
advantageous exemplary embodiments and modes of implementation, which 
are in no way limiting, with reference to the appended figures in which: 

- Figure 1 represents an image whose various horizontal and vertical 
lines have been highlighted, 

- Figure 2 represents a preferred embodiment of the invention. 

Figure 1 represents an image whose horizontal, vertical and oblique 
lines have been highlighted. 

Figure 1 represents more particularly an image representing a building 
and therefore comprising a considerable number of horizontal and vertical 
lines. 

Based on the fact that the photo was taken with a camera whose 
optical axis is situated in the horizontal plane, the effect of the perspective is 
that the vertical lines of the scene remain vertical, whereas the horizontal lines 
become oblique. 

The horizontal lines of the building, for example the lines delimiting the 
windows and the roof, have become oblique in perspective. On the other 
hand, the vertical lines, delimiting the contours of the building and of the 
windows, have remained vertical. 

The horizontal lines taken face-on remain horizontal. 

« 

Thus, the orientation of such a photo can be determined by calculating 
a percentage between the number of horizontal lines and the number of 
vertical lines. Indeed, this photo contains a considerable number of vertical 
lines, proportionally to the number of horizontal lines. It moreover contains a 
considerable number of oblique lines. 
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Figure 2 represents a flow chart of the operation of a method according 
to a preferred embodiment. 

The method comprises a first step E1 of contour detection so as to 
isolate the various lines present in the image. 

The detection of contours can be performed using various known 
procedures for detecting contours such as the procedures of Prewitt, Sobel or 
Canny-Deriche. Such procedures are described, for example, in the book by 
Cocquerez and Philipp entitled "Analyse damages; filtrage et segmentation 
[Image analysis: filtering and segmentation]", published in 1995 by Masson. 

This operation consists in estimating the local variation in luminance. 
For each pixel of the image, a modulus of the luminance gradient is 
computed, that is to say the intensity of the variation in luminance in a small 
local neighbourhood around this point. The pixels with the largest modulus of 
gradient are then regarded as being on contours. 

The contour detection step is followed by a thresholding step E2 
making it possible to isolate the contours. During this step, the modulus of the 
luminance gradient of the points that have been detected during the previous 
step as forming part of a line, is compared with a threshold. 

The threshold may be unique for the entire image or else it may vary as 
a function of the texture of the various regions of the image. 

A watershed algorithm can also be applied to obtain the contours. 

Following this thresholding operation, a binary image is obtained that 
represents partial contours, that is to say portions of curves. 

Thereafter, it may turn out to be necessary to delete the contours 
obtained in the thresholding step that are too small, or else to connect the 
disjoint but close contours. 

Next, the image is thereafter transformed during step E3 by using a 
Hough transformation so as to identify the lines in the image. The Hough 
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transform is a conventional procedure for detecting simple shapes in an 
image. This procedure forms part of the family of voting algorithms and may 
for example be used to detect straight lines or circles. 

This gives a set of lines aligned with the lines detected in the original 

image. 

The next step consists in measuring the predominant orientation. 

For each straight line detected in the image, a set of K attributes are 
computed during step E4 (number of points on the line, dispersion of the set 
of points, distances between points not connected so as to favour the lines 
that correspond to real objects, etc.) represented in the form of a vector of 
attributes F. 

F = (/J,*e[u:] 

Each line can be weighted. The lines whose points are not actually 
aligned have little probability of being lines and can therefore undergo a 
weighting so as to be taken into account less in the orientation decision. 

The orientation (or the inclination) of the lines is quantized, from 0 to n 
and the measurements are grouped together by angular interval. Thus, for 
each angular interval i, a certain number Ni of straight lines whose orientation 
lies in this interval is obtained. 

This quantization is not uniform in so far as the interval [0; n] is not 
divided into equal intervals but it is sliced up more finely around tc/2, so as to 
accentuate the fact that we are searching for the lines having an orientation of 
about tc/2. 

The interval [0; n] is divided into N intervals (ocj = 0, On= n). 

The intervals are not of equal size but are of smaller size around n/2. 
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The orientation of the image depends on the ratio of the number of 
horizontal to vertical lines. In order to take the decision, in this embodiment, 
use is made of a learning-based decision system, of neural network type. 

F; represents the attributes of straight line n in angular sector i. 

The inputs of the decision system are for each angular segment 

Si = [oci, ocj+i] 

the number Ni of straight lines detected in the angular segment, 

A vector of attributes Fj dependent on the set of vectors of attributes of 
these straight lines F„ f ; n e [l, N § ] 

Also, by way of illustration in this embodiment, the mean of the Ni 
vectors associated with each straight line detected in this interval, or any other 
function that summarizes these Ni vectors into a single one. 

These data collected for each interval constitute the inputs of a 
learning-based decision system such as a supervised classifier, for example a 
neural network. According to another embodiment, it is also possible to use a 
vector support machine (VSM) or any other technology belonging to the field 
of shape recognition. 

The way in which such a system operates is described in the document 
"Statistical Pattern Recognition: A Review" by Anil K. Jain, Robert P. W. Duin 
and Jianchang Mao published in November 1999 in the IEEE Transactions 
volume, PAMI 22(1), pages 4-37, 2000. 

The learning-based decision system is a system which models (step 
E5) example images in portrait or landscape mode and which thereafter 
deduces attributes therefrom. It can thus, as a function of the attributes, 
associate a portrait or landscape type with an incoming image. The attributes 
provided by the decision system are attributes identical to those provided as 
input to the decision system. This association is effected by comparing the 
vectors of attributes and thereafter, as a function of the value of the vectors of 
attributes, by comparing distance with the attribute vectors of the portrait class 
or of the landscape class. In this way, when it receives the vector of attributes 
as input, it can class, by comparison, the image into the portrait or landscape 
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category as a function of the example images that it has modeled and of the 
vector of attributes of this image. 

The VSMs model separation hyperplanes between the classes to be 
detected, either portrait or landscape: thereafter, depending on whether the 
attributes of a new image fall on one side or the other of the boundary 
between the two hyperplanes, the image is classed as portrait or landscape. 

The method of detecting the orientation of an image such as proposed 
in the invention fits advantageously into known methods of detecting the 
orientation of an image. Specifically, this method is particularly advantageous 
for images containing a large percentage of horizontal, oblique and vertical 
lines but exhibits less attractive results for images containing only people or 
for example landscapes. 

It is therefore attractive to combine this method with methods 
implementing steps of extracting high-level and low-level characteristics that 
are efficient for images exhibiting other types of content. 

Methods of detecting colour, for example the colour of the sky, are 
among the methods of extracting low-level characteristics. This is described 
for example in Patent Application EP 1107182 filed in the name of Kodak 
Industry on 17 November 2000. 

Procedures making it possible to detect faces in images which may 
subsequently allow the detection of the orientation of an image are known 
among methods of extracting high-level characteristics. 

Depending on the content of. the images, it is therefore advantageous 
to combine these procedures with the procedure according to the invention 
which is based on physical and geometrical properties of elements that may 
be present in the image. 



